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Abstract 

We present the largest area survey to date (1.4 deg 2 ) for Lya emitters (LAEs) at z ~ 9, as part of the Hi-z Emission 
Line Survey (HiZELS). The survey, which primarily targets Ha emitters at z < 3, uses the Wide Field CAMera on 
the United Kingdom Infrared Telescope and a custom narrow-band filter in the J band to reach a Lya luminosity 
limit of ~ 10 43,8 erg s~ x over a co-moving volume of 1.12 x 10 6 Mpc 3 at z = 8.96 db 0.06. Two candidates were 
found out of 1517 line emitters, but those were rejected as LAEs after follow-up observations. This improves the 
limit on the space density of bright Lya emitters by 3 orders of magnitude and is consistent with suppression of 
the bright end of the Lya luminosity function beyond z ~ 6. Combined with upper limits from smaller but deeper 
surveys, this rules out some of the most extreme models for high-redshift Lya emitters. The potential contamination 
of narrow-band Lya surveys at z > 7 by Galactic brown dwarf stars is also examined, leading to the conclusion that 
such contamination may well be significant for searches at 7.7 < z < 8.0, 9.1 < z < 9.5 and 11.7 < z < 12.2. 



1 Introduction 



Understanding how and when the first stars and galaxies formed is one of the most fundamental problems in 
astronomy. Furthermore, whilst many sophisticated models of early galaxy formation and evolution have been 
constructed, it is clear that observations of the most distant galaxies are mandatory to really test, refine, or refute 
such models. Indeed, considerable manpower and telescope time have been invested in such observations, with the 
detection of a Gamma Ray Burst (GRB) at z m 8.2 (Tanvir et al. 2009 1 being one of the most recent highlights of 
this extraordinary endeavor. However, despite the recent success in using GRBs to find the most distant sources, the 
current samples of high redshift galaxies have been mostly assembled using two methods: the broad-band drop-out 
technique and narrow-band imaging surveys. 

The widely-used drop-out technique (pioneered at z 



3 by Steidel et al. 1996 1 requires very deep broad-band 



imaging, and can identify z > 7 galaxies as z-band drop-outs (e.g. |Bouwens et al.| |2008[ |Richard et al.| |2008| ). 
Furthermore, the use of this technique, combined with the recent installation of the Wide Field Camera 3 (WFC3) 
on the Hubble Space Telescope (HST), has led to the identification of roughly 20 z m 7 — 8 candidates (e.g. 



Bouwens et al.| |2009[ |Oesch et alj |2009[ |McLure et al.[ |2009[ ). While this is an efficient method for identifying 
candidates, it still requires detailed spectroscopic follow-up to confirm them, especially to rule out contributions 
from other populations with large z— J breaks, such as dusty or evolved z ~ 2 galaxies and ultra-cool galactic stars 



(e.g. McLure et al.| 2006 1. Confirming the candidates is actually quite a significant challenge, since the typical 
z > 7 candidates found so far are just too faint for spectroscopic follow-up. 

The narrow-band imaging technique has the advantage of probing very large volumes looking for Lya in emis- 
sion. Whilst it can only detect sources with strong emission lines, and still depends on the Lyman-break technique 
to isolate very high-redshift emitters, it can yield suitable targets for follow-up spectroscopy with the current instru- 
mentation. Narrow-band Lya searches at 3 < z < 7 have been extremely successful in detecting and confirming 



*In this work, an Ho = 70kms 1 Mpc , Q,m = 0.3 and Qa = 0.7 cosmology is used and magnitudes are given in the Vega system. 
For full details, please refer to Sobral et al. (2009b). 
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emitters (e.g. |Hu et al.| 1998 ) and, so far, this technique has resulted in the spectroscopic confirmation of the highest 
redshift galaxy (z = 6.96: |Iye et al.[ [2006). Even more recently, [Hibon et alT] ( |2009| ) identified 7 candidate Lya 
emitters at z = 7.7. There have been attempts to detect Lya emitters at z ~ 9 (e.g. Willis & Courbinj 2005||Cuby| 



et al. 2007 Willis et al. 2008 1, but all such studies have been unsuccessful to date, having surveyed very small 
areas (a few tens of square arcmins at most). 

With the advent of wide-field near-IR detectors it is now possible to increase the sky area studied by over 2 to 3 
orders of magnitude and reach the regime where one can realistically expect to detect z ~ 9 objects. This is a key 



aim of, for example, the narrow-band component of the UltraVISTA Survey (c.f. Nilsson et al.| 2007 ). It is also an 
aim of HiZELS, the Hi-Z Emission Line Survey (c.f. |Geach etaL| |2008| [Sobral et al.[[2009a|bt|Garn et al4|2009] ), 
that we are carrying out using the WFCAM instrument on the 3.8-m UK Infrared Telescope (UKIRT). HiZELS is 
using a set of existing and custom-made narrow-band filters in the J, H and K bands to detect emission lines from 
galaxies at different redshifts over ~ 10 square degrees of extragalactic sky. In particular, the narrow-band J filter 
(hereafter NBj) is sensitive to Lya at z = 8.96. 



2 Data, selection and candidates 

Deep narrow-band J (NBj 21.6, 3a, F um = 7.6 x 10~ 17 erg s^ 1 cm -2 ) imaging was obtained across 1.4 



deg^ in the UKIRT Infrared Deep Sky Survey Ultra Deep Survey (UKIDSS UDS; |Lawrence et al.||2007 ) and the 
Cosmological Evolution Survey (COSMOS ; |Scoville et al.[ [2007 ) fields, both of which have a remarkable set of 
deep multi-wavelength data available - this resulted in the selection of 1517 potential line emitters. The NBj filter 
(A = 1.211 ±0.015/im) is sensitive to Lya emission at z = 8.96 ±0.06, probing a co-moving volume of 1.12 xlO 6 
Mpc 3 - by far the largest probed by a narrow-band survey at these wavelengths. Details regarding the observations, 



data reduction and the general selection of NB j emitters can be found in Sobral et al. (2009a). 

For a source to be considered a candidate z « 9 Lya emitter it is required to: i) be selected as a narrow-band 
emitter in Sobral et al. (2009a); ii) have at least one other detection > 3a in the near-infrared; iii) be visually 



believable in NBj and the other band(s), avoiding noisy areas; and iv) be undetected (< 3a and direct visual 
analysis) in the available visible band imaging (B,V,r,i,z) - SUBARU and ACS/HST. 

No candidates were found in the UKIDSS UDS field, with all emitters that passed tests i) to iii) being clearly 
detected in z-band imaging. In COSMOS, however, 2 candidates were found that satisfied all criteria. The brightest 
source was followed-up spectroscopically using the CGS4 instrument on UKIRT in January 2009 - these data failed 
to confirm an emission line. Both candidates were then re-observed using WFCAM (further J imaging in February 
2009), resulting in the non-detection of both candidates. Further investigation shows that the sources are likely to 
be artifacts caused by an unfortunate coincidence of a set of slightly hot pixels (not sufficient to be flagged as bad 
pixels) which, combined with the ditter pattern, produced a few a excess at one location on the combined image. 



3 Lya luminosity function at z ~ 9 

A non-detection of (L > 7.6 x 10 43 ergs _1 ) Lya emitters at z ~ 9, in a co-moving volume of 1.12xl0 6 Mpc 3 
allows the tightest constraint on the bright end of the z ~ 9 Lya luminosity function, as previous surveys (Willis & 



Courbin[ 2005 [ Cuby et al. 2007 ; Willis et aL| [2008 ) have only covered very small areas (a factor ~1000 smaller). 
However, since those surveys have gone significantly deeper (up to a factor of ~100), combining all the results 
from the literature can constrain the Lya luminosity function across a wide range of luminosities (10 42 < L < 
10 45 ergs _1 ). The left panel of Figure [I] presents such constraints, indicating the inverse of the volume selection 
function for each survey. These are compared to the measured Lya luminosity functions from z ~ 3 to z ~ 7, 
revealing that there is little evolution in the bright end of the luminosity function between z ~ 3 and z ~ 5.7. 
Nevertheless, those bright emitters seem to become much rarer at z = 6.5 (Kashikawa et al. 2006 1, indicating 
that L* is not increasing from z ~ 6 onwards. The results presented here are also consistent with no (or negative) 
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Figure 1: Left: Comparison between the measured Lya luminosity function at z ~ 3 (dotted lines; 
2008) with data from z ~ 6 - 7 l |Kashikawa et al.||2006HShimasaku et al.||2006||Ota et"al7||2008^. No ev idence of significant evolution 
is found, especially when accounting for cosmic variance. Limits for the z ~ 9 LF from |Willis & Courbin]{2l)05l >, |Cuby et al.|(2007) and 
Willis et al. (20081 are also presented, together with the one presented in this contribution. Right: The observational limits on the z ~ 9 
Lya luminosity function compared to different model predictions and proposed future surveys, showing that the most recent versions of 
these models are completely consistent with the observations. 



evolution in L* (Alog(L*)<0.5) from z = 5.7 to z ~ 9. 
3.1 Comparison with models and future surveys 

Many authors have made predictions regarding the Lya luminosity function at z ~ 9, either by extrapolating the 
luminosity function of these emitters from lower redshift, or by using numerical or semi-analytical models. The 
semi-analytical models discussed here are obtained from GALFORM (Baugh et al. 2005[ ) - these are based on 
ACDM, having been successful in reproducing a wide range of galaxy properties at different redshifts, including 
Lya emitters up to z ~ 6 (c.f. |Baugh et al.[ 2005 Le Delliou et al.| 2006 Orsi et al. 2008 1. The observational 



approach, as in |Nilsson et al.| ( |2007| ), extrapolates the Schechter function parameters based on those obtained in the 
3.1 < z < 6.5 redshift range. In practice, this results in little L* evolution but a significant negative (jf evolution. 
Finally, the phenomenological approach in Thommes & Meisenheimer (2005 ) assumes that Lya emitters at high 
redshift are spheroids seen during their formation phase. Each galaxy is assumed to be visible as a Lya emitter 
during a starburst phase of fixed duration that occurs at a specific redshift, drawn from a broad distribution (c.f. 
Thommes & Meisenheimer, 2005). 

The right panel of Figure [T] presents predictions from GALFORM ( Le Delliou et al.| 2006| ), the observational 
luminosity function extrapolation from Nilsson et al. (2007 ) and updated phenomenological predictions (Thommes 
& Meisenheimer, 2005) assuming peak redshifts of z max = 3.4 and z max = 5.0. While most predictions are 
consistent with the current limits, GALFORM models with high escape fractions are marginally rejected both at faint 
and bright levels. Earlier phenomenological models (e.g. the z max 
2005 not shown in Figure [TJ are also clearly rejected by our results. 



10 model of Thommes & Meisenheimer 



4 High-redshift Lya searches and cool galactic stars 

It has become widely realised in recent years that broad-band searches for z > 6 galaxies using the Lyman-break 
technique may suffer from significant contamination by cool Galactic L, T, and possibly Y-dwarf stars (e.g. |McLure 
et al.| |2006[ ). These low-mass brown dwarfs display extremely red z — J colours reaching as high as z — J ~ 4 
(e.g. |Burningham et al. 2008| ), coupled with relatively flat J — K colours. Such colours can mimic very closely 
those expected of a z > 6 star forming galaxy with a strong Lyman-break. 

Since the near-infrared continuum spectra of low mass brown dwarfs show considerable structure due to broad 
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Figure 2: Top panel: the near-infrared spectra of TO, T3, T6 and T9 dwarf stars (TO - lighter, T9 - darker, from Burningham et al. 2008 
compared to near-IR broad band filter profiles. Lower panel: the consequences for measured broad-band minus narrow-band (BB-NB) 
colours, clearly demonstrating the redshifts/wavelengths at which searches for Lya emitters can be significantly contaminated by these very 
cool stars. For 7.7 < z < 8.0 and 9.1 < z < 9.5 searches, these stars can easily mimic Lya emitters, with strong Y-z or J-z breaks and 
significant positive BB-NB colours. Searches at higher redshift 11.6 < z < 12.2 in the H band can detect T9s with BB-NB~1.5, although 
the lack of strong H-J or H-Y breaks will make it easier to distinguish T-dwarfs from Lya emitters. 



molecular absorption features (especially methane and ammonia; e.g. Leggett et al. 2007 1, as shown in the top 
panel of Figure [2j they can easily produce a positive broad-band minus narrow-band (BB-NB) colour (see lower 
panel of Figure [2} if the narrow-band filter is located within one of the spectral peaks (this is much less of an issue 
for surveys which difference two closely-located narrow-band filters). Lya narrow-band surveys in the redshift 
ranges 7.7 < z < 8.0, 9.1 < z < 9.5 and 11. 7 < z < 12.2 are therefore prone to contamination by cool Galactic 
stars - this includes the z = 7.7 and z = 9.4 atmospheric windows for narrow-band searches of Lya emitters. 
Narrow-band surveys at redshifts z < 7.7, or between 8.0 < z < 9.1 - which include both HiZELS (z = 8.96) 
and the narrow-band component of the Ultra VISTA Survey (z = 8.8; e.g. Nilsson et al 2007) - will not only be 
free of such contamination, but can potentially select very cool T-dwarf stars via a narrow-band deficit (due to the 
strong methane absorption feature at these wavelengths). Indeed, motivated by such finding, a T-dwarf search was 
conducted among narrow-band deficit sources from Sobral et al. (2009a). The results show that all those sources are 
galaxies with z p hoto ~ 1.4 — 1.5, probably placing the H/3 and [Olll] emission lines just outside the narrow-band 
coverage, but contributing significantly to the measured J flux, which results in the observed narrow-band deficits. 
No T-dwarf candidate was found. 



5 Summary 

• Deep narrow-band imaging in the J band (A = 1.211 ± 0.015/im) has been used to search for bright Lya 
emitters at z = 8.96 over an area of 1.4 deg 2 . No Lya emitter was found brighter than L ps 7.6 x 10 43 erg s _1 . 

• The Lya luminosity function constraints at z ~ 9 have been significantly improved for L > 10 43 8 erg s _1 
and combined with constraints from deeper but much smaller previous surveys. The results rule out signifi- 
cant positive evolution of the Lya LF beyond z ~ 6; they are in line with recent semi-analytic & phenomeno- 
logical model predictions, rejecting some extreme models. 

• It has been shown that for narrow-band searches, T-dwarfs can mimic Lya emitters at 7.7 < z < 8.0, 
9.1 < z < 9.5 and 11.7 < z < 12.2; they will not contaminate the future Ultra VISTA narrow-band survey 
(and can even be identified via a narrow-band deficit), but they may contaminate narrow-band Lya searches 
within the z = 7.7 and z = 9.4 atmospheric windows. 
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These results show that bright L > 10 438 erg s _1 Lya emitters are extremelly rare. Although the area coverage 
is absolutely important, a depth+area combination is likely to be the best approach for gathering the first sample 
of these very high-redshift galaxies. In fact, that is the strategy of the narrow-band component of the UltraVISTA 
survey (c.f. |Nilsson et alj |2007| , using the VISTA telescope, which will map 0.9 deg 2 of the COSMOS field to a 
planned 5a luminosity limit of L = 10 42 53 erg s^ 1 and a surveyed volume of 5.41 x 10 5 Mpc 3 (see right panel of 
Figure [TJ at z = 8.8. This combination lies below all current predictions for the z ~ 9 Lya LF and the survey is 
expected to detect 2-20 Lya emitters at z = 8.8 ± 0.1. Furthermore, the continuation of HiZELS on UKIRT and 
the extension of the narrow-band J survey to a wider area offers a complementary approach which might be able 
to detect one of the brightest Lya emitters at z ~ 9, perfectly suited for spectroscopic follow-up and potentially 
enabling the detailed studies which simply won't be possible for much fainter emitters, even if they are detected. 
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